Ultrasound remote diagnosis system and method thereof

ABSTRACT

An ultrasound remote diagnosis system according to an embodiment of the present disclosure includes a main body including a main panel, a touch panel, and a control panel, and a remote device in communication with the main body, wherein the remote device is configured to: independently receive, among display data which is real-time image information of the main panel, first control data which is real-time image information of the touch panel, and second control data which is a virtual control panel corresponding to the control panel, at least each information corresponding to the display data and the first control data, from the main body; and the main body is configured to receive a marker information for measurement input to at least one of the display part, the first controller, and the second controller of the remote device and display on the main panel.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority under 35 U.S.C. § 119(a) toKorean patent application number 10-2022-0083415 filed on Jul. 6, 2022,and 10-2022-0121198 filed on Sep. 23, 2022 in the Korean IntellectualProperty Office, the entire disclosure of which is incorporated byreference herein.

BACKGROUND 1. Technical Field

The present disclosure relates to an ultrasound remote diagnosis systemand an ultrasound remote diagnosis method, and more particularly, to anultrasound diagnosis system and a diagnosis method capable of remotelydiagnosing ultrasound.

2. Related Art

Ultrasound imaging refers to imaging of sound waves reflected from theinside of a human body after sending high-frequency sound waves from asurface of the human body to the inside and the ultrasound examinationprovides ultrasound images in real time. Conventionally, an ultrasounddiagnosis apparatus is being changed from an analog type to a digitaltype as well as from 2D ultrasound diagnosis apparatuses to 3D and then4D ultrasound diagnosis apparatuses that include the passage of time,and recently, 4D ultrasound examination is also being applied, whichshows the movement of 3D images.

The ultrasound diagnosis apparatus is an apparatus which irradiatesultrasound signals generated from a transducer of a probe to an objectand receives information of echo signals reflected from the object toacquire an image of an internal part of the object, and such anultrasound diagnosis apparatus exhibits higher stability than adiagnosis apparatus using X-rays while the real-time image display ispossible, thereby being widely used along with other imaging diagnosisapparatuses. In particular, ultrasound diagnosis apparatuses, which aremore accurate than other diagnosis apparatuses and are safe due to norisk of radiation exposure to the human body, are widely used in variousdiagnostic processes.

With the development of ultrasound remote diagnosis technology, it hasbecome possible to diagnose or treat bedside at a remote location, andrecently, ultrasound remote diagnosis technology has been used in thetraining process of ultrasound apparatuses.

SUMMARY

Embodiments provide an ultrasound remote diagnosis system and adiagnosis method that facilitate remote diagnosis by improvingoperational inconvenience in the ultrasound remote diagnosis process andincrease the accuracy of diagnosis.

In accordance with an aspect of the present disclosure, there isprovided an ultrasound remote diagnosis system, including a remotedevice in communication with a main body including a main panel, a touchpanel, and a control panel, wherein the remote device is configured to:independently receive, among display data which is real-time imageinformation of the main panel, first control data which is real-timeimage information of the touch panel, and second control data which is avirtual control panel corresponding to the control panel, at least eachinformation corresponding to the display data and the first controldata, from the main body; and display a display part, a firstcontroller, and a second controller respectively corresponding to thedisplay data, the first control data, and the second control data so asnot to overlap, and wherein in a measurement mode for measuring anobject based on a marker set in an ultrasound image displayed on themain panel, the marker information for measurement input to at least oneof the display part, the first controller, and the second controller istransmitted to the main body to be displayed on the main panel.

In accordance with another aspect of the present disclosure, there isprovided an ultrasound remote diagnosis system, including a main body incommunication with a remote device, wherein the main body includes amain panel, a touch panel, and a control panel, and in order for theremote device to display a display part, a first controller, and asecond controller respectively corresponding to display data which isreal-time image information of the main panel, first control data whichis real-time image information of the touch panel, and second controldata which is a virtual control panel corresponding to the controlpanel, so as not to overlap, the main body is configured toindependently transmit, among the display data, the first control dataand the second control data, at least each information corresponding tothe display data and the first control data, to the remote device, andwherein in a measurement mode for measuring an object based on a markerset in an ultrasound image displayed on the main panel, the markerinformation for measurement input to at least one of the display part,the first controller, and the second controller is received by the mainbody to be displayed on the main panel.

In accordance with another aspect of the present disclosure, there isprovided an ultrasound remote diagnosis system, including a main bodyincluding a main panel, a touch panel, and a control panel, and a remotedevice in communication with the main body, wherein the remote device isconfigured to: independently receive, among display data which isreal-time image information of the main panel, first control data whichis real-time image information of the touch panel, and second controldata which is a virtual control panel corresponding to the controlpanel, at least each information corresponding to the display data andthe first control data, from the main body; and display a display part,a first controller, and a second controller respectively correspondingto the display data, the first control data, and the second control dataso as not to overlap, and the main body is configured to, in ameasurement mode for measuring an object based on a marker set in anultrasound image displayed on the main panel, receive the markerinformation for measurement input to at least one of the display part,the first controller, and the second controller of the remote device anddisplay on the main panel.

Specifically, in the measurement mode, a measurement process performedby the main body and the remote device may be displayed in the samemanner on the main panel and the display part.

Specifically, in the measurement mode, at least one of a first pointercorresponding to a mouse cursor of the main body and a second pointercorresponding to a mouse cursor of the remote device may be displayed onthe display part.

Specifically, the measurement mode may be executed by moving the secondpointer inside an area of the display part or through control of thesecond controller.

Specifically, the measurement mode may be executed through control ofthe main panel or the touch panel.

Specifically, a measurement in the measurement mode may use at least oneof the first pointer and the second pointer.

Specifically, when the second pointer is located within an area of thedisplay part, the second pointer may be displayed in a form of ameasurement marker.

Specifically, a first measurement marker may be displayed at a pointwhere the second pointer is located, a first point may be specified byclicking the first measurement marker, and when the second pointermoves, a second measurement marker may be displayed at a moved location,and a second point may be specified by clicking the second measurementmarker.

Specifically, a connection line connecting the first point and thesecond point may be displayed.

Specifically, the touch panel and the first controller, and the controlpanel and the second controller may each independently perform two-waytransmission and reception.

Specifically, the remote device capable of remotely accessing the mainbody may be at least one.

In accordance with another aspect of the present disclosure, there isprovided an ultrasound remote diagnosis method of an ultrasound remotediagnosis system including a main body including a main panel, a touchpanel, and a control panel, and a remote device in communication withthe main body, the method including independently receiving, by theremote device, among display data which is real-time image informationof the main panel, first control data which is real-time imageinformation of the touch panel, and second control data which is avirtual control panel corresponding to the control panel, at least eachinformation corresponding to the display data and the first controldata, from the main body, displaying, by the remote device, a displaypart, a first controller, and a second controller respectivelycorresponding to the display data, the first control data, and thesecond control data so as not to overlap, and in a measurement mode formeasuring an object based on a marker set in an ultrasound imagedisplayed on the main panel, receiving, by the main body, the markerinformation for measurement input to at least one of the display part,the first controller, and the second controller to display on the mainpanel.

Specifically, in the measurement mode, the method may include displayinga measurement process performed by the main body and the remote devicein the same manner on the main panel and the display part.

Specifically, in the measurement mode, at least one of a first pointercorresponding to a mouse cursor of the main body and a second pointercorresponding to a mouse cursor of the remote device may be displayed onthe display part.

Specifically, the method may include executing the measurement mode bymoving the second pointer inside an area of the display part or throughcontrol of the second controller.

Specifically, the method may include executing the measurement modethrough control of the main panel or the touch panel.

Specifically, a measurement in the measurement mode may use at least oneof the first pointer and the second pointer.

Specifically, the method may include when the second pointer is locatedwithin an area of the display part, displaying the second pointer in aform of a measurement marker.

Specifically, the method may include specifying a first point byclicking a first measurement marker displayed at a point where thesecond pointer is located, and specifying a second point by clicking asecond measurement marker displayed at a location where the secondpointer moved.

Specifically, the method may further include displaying a connectionline connecting the first point and the second point.

Specifically, the touch panel and the first controller, and the controlpanel and the second controller may each independently perform two-waytransmission and reception.

Specifically, the remote device capable of remotely accessing the mainbody may be at least one.

An ultrasonic remote diagnosis system and diagnostic method according tothe present disclosure may facilitate remote diagnosis by increasing theaccuracy of a measurement result of an object during an ultrasoundremote diagnosis process, and improving the operational inconvenience ofremote control.

The effect of the present disclosure is not limited to theabove-mentioned effects, and effects not mentioned may be clearlyunderstood by those skilled in the art to which the present disclosurepertains from the present specification and the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

Example embodiments will now be described more fully hereinafter withreference to the accompanying drawings; however, they may be embodied indifferent forms and should not be construed as limited to theembodiments set forth herein. Rather, these embodiments are provided sothat this disclosure will be thorough and complete, and will fullyconvey the scope of the example embodiments to those skilled in the art.

In the drawing figures, dimensions may be exaggerated for clarity ofillustration. It will be understood that when an element is referred toas being “between” two elements, it can be the only element between thetwo elements, or one or more intervening elements may also be present.Like reference numerals refer to like elements throughout.

FIG. 1 is a block diagram illustrating a configuration of an ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

FIG. 2 is a block diagram illustrating a configuration of the ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

FIG. 3 is a block diagram illustrating a configuration of the ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

FIGS. 4A to 4C are perspective views of an ultrasound diagnosisapparatus 200 in accordance with at least one embodiment of the presentdisclosure.

FIGS. 5A to 5C are perspective views of an ultrasound diagnosisapparatus 500 in accordance with at least one embodiment of the presentdisclosure.

FIG. 6A is a diagram for explaining a conventional ultrasound remotediagnosis system.

FIG. 6B is a diagram for explaining a conventional ultrasound remotediagnosis system.

FIG. 7A is a diagram for explaining an ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

FIG. 7B is a diagram for explaining an ultrasound remote diagnosissystem 700 in accordance with another embodiment of the presentdisclosure.

FIG. 8 is a diagram for explaining a measurement mode of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 9A is a diagram for explaining a process of executing themeasurement mode of the ultrasound remote diagnosis system 700 inaccordance with an embodiment of the present disclosure.

FIGS. 9B to 9C are a diagram for explaining a process of executing themeasurement mode of the ultrasound remote diagnosis system 700 inaccordance with an embodiment of the present disclosure.

FIGS. 10A to 10D are a diagram for explaining a remote measurementprocess in the ultrasound remote diagnosis system 700 in accordance withan embodiment of the present disclosure.

FIGS. 11A to 11I are a diagram illustrating various embodiments ofmeasurement markers 742, 744 and a second pointer 740 in the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 12A is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 12B is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with another embodiment of thepresent disclosure.

FIG. 13 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 14 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 15 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 16 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 17 is a diagram for explaining a remote track ball 727 controlmethod of the ultrasound remote diagnosis system 700 in accordance withan embodiment of the present disclosure.

FIG. 18 is a diagram for explaining a method of controlling the remotetrack ball 727, in the remote track ball 727 control method of theultrasound remote diagnosis system 700 in accordance with the presentdisclosure.

FIG. 19 is a diagram for explaining another embodiment in the remotetrack ball 727 control method of the ultrasound remote diagnosis system700 in accordance with the present disclosure.

FIG. 20A is a diagram for explaining size control of a second controller726, in the remote track ball 727 control method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 20B is a diagram for explaining size control of the secondcontroller 726, in the remote track ball 727 control method of theultrasound remote diagnosis system 700 in accordance with an embodimentof the present disclosure.

FIG. 21A is a diagram for explaining the second controller 726, in theremote track ball 727 control method of the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

FIG. 21B is a diagram for explaining the second controller 726, in theremote track ball 727 control method of the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

FIG. 22 is a diagram for explaining the second controller 726, in theremote track ball 727 control method of the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

DETAILED DESCRIPTION

The present specification clarifies the scope of the present disclosureand, to enable those of ordinary skill in the art to which the presentdisclosure pertains to practice the present disclosure, the principle ofthe present disclosure is explained and embodiments are disclosed. Thedisclosed embodiments may be implemented in various forms.

Throughout the specification, when a part is “connected” to anotherpart, it includes not only a case of being directly connected but also acase of being indirectly connected, and the indirect connection includesconnection through a wireless communication network.

In addition, terms used herein are used to describe the embodiments, notintended to limit and/or restrict the disclosed invention. The singularexpression includes the plural expression unless the context clearlydictates otherwise. In the present specification, terms such as“comprise” or “have” specify the presence of stated features, integers,steps, operations, elements, components or a combination thereof, but donot preclude the presence or addition of one or more other features,integers, steps, operations, elements, components, a combinationthereof.

Further, although terms including ordinal numbers such as “first,”“second,” and the like are used to explain various components, thecomponents are not limited to such terms and these terms are used onlyto distinguish one component from another component. For example, afirst component may be referred to as a second component, or similarly,the second component may be referred to as the first component withinthe scope of the present disclosure.

In addition, terms such as “unit”, “group”, “block”, “member”, and“module” may refer to a unit that processes at least one function oroperation. For example, the terms may refer to at least one processprocessed by at least one hardware such as a field-programmable gatearray (FPGA)/application specific integrated circuit (ASIC), at leastone software stored in a memory, or a processor.

Symbols given to each step are used to identify each step, and thesesigns do not indicate the order between the steps, and each step may beperformed differently from the stated order unless the context clearlyindicates a specific order.

In addition, an image herein may include a medical image acquired by amedical imaging apparatus such as a magnetic resonance imaging (MRI)apparatus, a computed tomography (CT) apparatus, an ultrasound imagingapparatus, or an X-ray imaging apparatus, and ultrasound images andmedical images of other modalities other than ultrasound may be providedor controlled.

Further, the term ‘object’ as used herein refers to a subject to bephotographed, and may include human, animal, or a part thereof. Forexample, the object may include a part of the body (such as organs) or aphantom.

Throughout the specification, the term “ultrasound image” as used hereinrefers to an image for an object transmitted to the object and processedbased on an ultrasound signal reflected from the object.

Hereinafter, an embodiment according to the present disclosure will bedescribed in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating a configuration of an ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

The ultrasound diagnosis apparatus 100 according to an embodiment of thepresent disclosure may include a probe 20, an ultrasonic transceiver110, a controller 120, an image processor 130, a display unit 140, astorage 150, a communication unit 160, and an input unit 170.

The ultrasound diagnosis apparatus 100 may be provided not only as acart type but also as a portable type. Examples of the portableultrasound diagnosis apparatus may include a smart phone, a laptopcomputer, a PDA, and a tablet PC including a probe and an application,but are not limited thereto.

The probe 20 may include a plurality of transducers. The plurality oftransducers may transmit an ultrasound signal to an object 10 accordingto a transmission signal applied from a transmitter 113. The pluralityof transducers may be configured to receive the ultrasound signalreflected from the object 10 to generate a received signal. In addition,the probe 20 may be integrated with the ultrasound diagnosis apparatus100 or may be provided as a separate type connected to the ultrasounddiagnosis apparatus 100 by a wire or wirelessly. Moreover, theultrasound diagnosis apparatus 100 may include one or a plurality ofprobes 20 according to an implementation form.

The controller 120 is configured to control, in consideration of theposition and focal point of the plurality of transducers included in theprobe 20, the transmitter 113 to generate a transmission signal to beapplied to each of the plurality of transducers.

The controller 120 is configured to convert the received signal receivedfrom the probe 20 from analog to digital and, in consideration of thepositions and focal points of the plurality of transducers, add thedigitally converted received signals to control the receiver 115 togenerate ultrasound data.

The image processor 130 is configured to generate an ultrasound image byusing the ultrasound data generated by the ultrasound receiver 115.

Meanwhile, the ultrasound image may represent the motion of the objectas a Doppler image as well as a gray scale ultrasound image obtained byscanning the object according to the A mode (amplitude mode), the B mode(brightness mode), and the M mode (motion mode).

A-mode is the most basic form of ultrasound image display method, whichis a method that displays the intensity of the reflected sound as theamplitude size on the time (distance) axis, and if the reflected soundis strong, the amplitude is high, and if the reflected sound is weak,the amplitude is low, which is advantageous for distance measurement,but this mode is rarely used at present because the image changes evenif the direction of the probe is slightly changed.

M-mode is a mode in which the distance of the moving reflector isdisplayed as a temporal change in the changed form of A-mode. Byspecifying the region of interest (ROI) in the 2D image as an M line anddisplaying the change over time in that area, it is mainly used toobserve heart valves, and may also record fetal heart sounds, but hasrecently been replaced by the Doppler method.

B-mode is a method of displaying the reflected sound as the brightnessof a dot, which is currently used in most ultrasound diagnosticequipment, and the brightness of each dot is proportional to theamplitude of the reflected signal, and recently provides a brightnesslevel of 256 or more, and is also a mode in which long-term motions arevisualized and displayed as they are in real time. The mode called 2Dmode, which means B (brightness) mode, displays the cross-sectionalimage of an object in real time on the screen in black and white shades,and is the most used mode.

In addition, the Doppler mode is a mode that measures blood flow bydetecting the flow of red blood cells in blood vessels in general, whichuses the principle that the wavelength shortens when red blood cellsapproach the probe and lengthens when they move away, and there arecolor Doppler, pulse wave Doppler (PW), continuous wave Doppler (CW),etc., according to the method of displaying blood flow. The Dopplerimage may include a blood flow Doppler image showing blood flow (alsocalled color Doppler image), a tissue Doppler image showing tissuemovement and a spectral Doppler image displaying the moving speed of theobject in a waveform.

In addition, as a composite mode, there are a mode in which two or threemodes are simultaneously applied to one image to display other modesbased on 2D, and a 3D mode in which a 3D stereoscopic image isdisplayed.

In the B-mode processing process, B-mode components are extracted andprocessed from ultrasound data, and in the image generation process, anultrasound image in which signal intensity is expressed as brightnessmay be generated based on the B mode component extracted in the B modeprocessing process. In the Doppler processing process, Dopplercomponents are extracted from ultrasound data, and in the imagegeneration process, a Doppler image expressing the motion of the objectin color or waveform may be generated based on the extracted Dopplercomponent.

In the image generation process, a 2D ultrasound image or a 3D image ofthe object may be generated, and an elastic image obtained by imagingthe degree of deformation of the object according to pressure may alsobe generated. Furthermore, various types of additional information maybe expressed as text or graphics on the ultrasound image. Meanwhile, thegenerated ultrasound image may be stored in a memory.

In the process of measuring the object in the ultrasound image, ameasurement tool for measuring the object may be determined, and one ofa plurality of measurement tools may be selected based on a user input.

For example, a measurement tool selection menu for selecting one of theplurality of measurement tools may be provided, and the measurement toolselection menu may be displayed on one screen together with theultrasound image. In addition, the measurement tool selection menu maybe displayed on a separate screen different from the touch screen onwhich the ultrasound image is displayed.

In addition, one of the plurality of measurement tools may be determinedbased on a user input for selecting one of the plurality of measurementitems to be measured. The measurement item may include, but is notlimited to, length, width, or angle.

As a user input for selecting one of the measurement items is received,a predetermined measurement tool may be determined corresponding to theselected measurement item.

The display unit 140 may be configured to display the generatedultrasound image and various information processed in the ultrasounddiagnosis apparatus 100. The ultrasound diagnosis apparatus 100 mayinclude one or a plurality of display units 140 according to animplementation form. In addition, the display unit 140 may be providedas a touch screen in combination with a touch panel.

The controller 120 may control the overall operation of the ultrasounddiagnosis apparatus 100 and a signal flow between internal components ofthe ultrasound diagnosis apparatus 100. The controller 120 may include amemory configured to store a program or data for performing a functionof the ultrasound diagnosis apparatus 100, and a processor configured toprocess a program or data. In addition, the controller 120 may beconfigured to receive a control signal from the input unit 170 or anexternal device to control the operation of the ultrasound diagnosisapparatus 100.

The ultrasound diagnosis apparatus 100 may include the communicationunit 160 and be connected with an external device (e.g., a server, amedical device, a portable device (smartphones, tablet PCs, wearabledevices, etc.)) through the communication unit 160.

The communication unit 160 may include one or more components thatenable communication with the external device, including, for example,at least one of short-range communication modules, wired communicationmodules, and wireless communication modules.

It is also possible that the communication unit 160 receives a controlsignal and data from the external device and transmits the receivedcontrol signal to the controller 120 so as to have the controller 120control the ultrasound diagnosis apparatus 100 according to the receivedcontrol signal.

Alternatively, it is also possible that the controller 120 transmits acontrol signal to the external device through the communication unit 160to control the external device in accordance with the control signal ofthe controller.

For example, the external device may be configured to process data ofthe external device in accordance with the control signal of thecontroller received through the communication unit.

A program (such as artificial intelligence) capable of controlling theultrasound diagnosis apparatus 100 may be installed in the externaldevice, such that the program may include instructions for performingsome or all of the operations of the controller 120.

The program may be preinstalled in the external device or may beinstalled by downloading, by a user of the external device, the programfrom a server that provides an application. The server providing theapplication may include a recording medium in which the correspondingprogram is stored.

In addition, the program may include a storage medium of a server or astorage medium of a client device in a system consisting of a server anda client device. Alternatively, if there is a third device (smartphones,tablet PCs, wearable devices, etc.) that is communicatively connected tothe server or client device, the program product may include a storagemedium of the third device. Alternatively, the program may include a S/Wprogram itself transmitted from the server to the client device or thethird device, or transmitted from the third device to the client device.

In this case, one of the server, the client device, and the third devicemay execute the program to perform methods according to the disclosedembodiments. Alternatively, two or more of the server, the clientdevice, and the third device may execute the program to perform themethods according to the disclosed embodiments by distributing themethods.

For example, a server (e.g., a cloud server or an artificialintelligence server, etc.) may execute a program stored in the server,so as to control the client device that is communicatively connected tothe server to perform the method according to the disclosed embodiments.

The storage 150 may be configured to store various data or programs fordriving and controlling the ultrasound diagnosis apparatus 100,input/output ultrasound data, and an acquired ultrasound image.

The input unit 170 may be configured to receive a user input forcontrolling the ultrasound diagnosis apparatus 100. For example, theuser input may include an input for manipulating a button, a keypad, amouse, a trackball, a jog switch, a knob, etc., an input for touching atouch pad or a touch screen, a voice input, a motion input, and an inputof biometric information (e.g., iris recognition, fingerprintrecognition, etc.), but is not limited thereto.

FIG. 2 is a block diagram illustrating a configuration of the ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

Referring to FIG. 2 , the ultrasound diagnosis apparatus 100 may includea wireless probe 20 and an ultrasound system 40.

The wireless probe 20 may include the transmitter 113, a transducer 117,a receiver 115, a controller 118, and a communication unit 119. It isshown in FIG. 2 that the wireless probe 20 includes both the transmitter113 and the receiver 115, but depending on the implementation, thewireless probe 20 may include only a part of the configuration of thetransmitter 113 and the receiver 115, and a part of the configuration ofthe transmitter 113 and the receiver 115 may be included in theultrasound system 40. Alternatively, the wireless probe 20 may furtherinclude the image processor 130.

The transducer 117 may include a plurality of transducers. The pluralityof transducers may be configured to transmit an ultrasound signal to theobject 10 according to a transmission signal transmitted from thetransmitter 113. The plurality of transducers may be configured toreceive the ultrasound signal reflected from the object 10 to generate areceived signal.

The controller 118 is configured to control the transmitter 113 togenerate a transmission signal to be transmitted to each of theplurality of transducers in consideration of the positions and focalpoints of the plurality of transducers.

The controller 118 is configured to convert the received signal receivedfrom the transducer 117 from analog to digital and, in consideration ofthe positions and focal points of the plurality of transducers, sum upthe digitally converted received signals to control the receiver 155 togenerate ultrasound data. Alternatively, when the wireless probe 20includes the image processor 130, it is possible to generate anultrasound image using the generated ultrasound data.

The communication unit 119 may be configured to wirelessly transmit thegenerated ultrasound data or ultrasound image to the ultrasound system40 through a wireless network. Alternatively, the communication unit 119may be configured to receive a control signal and data from theultrasound system 40.

In addition, the ultrasound diagnosis apparatus 100 may include one ormore wireless probes 20 according to an implementation form.

The ultrasound system 40 may be configured to receive ultrasound data oran ultrasound image from the wireless probe 20. The ultrasound system 40may include the controller 120, the image processor 130, the displayunit 140, the storage 150, the communication unit 160, and the inputunit 170.

The image processor 130 may be configured to generate an ultrasoundimage by using the ultrasound data received from the wireless probe 20.

The display unit 140 may be configured to display an ultrasound imagereceived from the wireless probe 20, an ultrasound image generated inthe ultrasound system 40, and various information processed in theultrasound diagnosis apparatus 100. The ultrasound diagnosis apparatus100 may include one or a plurality of display units 140 according to animplementation form. In addition, the display unit 140 may be providedas a touch screen in combination with a touch panel.

The controller 120 may be configured to control the overall operation ofthe ultrasound diagnosis apparatus 100 and the signal flow among theinternal components of the ultrasound diagnosis apparatus 100. Thecontroller 120 may include a memory configured to store a program ordata for performing a function of the ultrasound diagnosis apparatus100, and a processor configured to process a program or data. Further,the controller 120 may be configured to receive a control signal fromthe input unit 170 or an external device to control the operation of theultrasound diagnosis apparatus 100.

The ultrasound system 40 may include the communication unit 160 and beconnected with the external device (e.g., a server, a medical device, aportable device (smartphones, tablet PCs, wearable devices, etc.))through the communication unit 160.

The communication unit 160 may include one or more components thatenable communication with the external device, including, for example,at least one of short-range communication modules, wired communicationmodules and wireless communication modules.

It is also possible that the communication unit 160 transmits andreceives a control signal and data from the external device andtransmits the received control signal to the controller 120 so as tohave the controller 120 control the ultrasound diagnosis apparatus 100according to the received control signal.

Alternatively, it is also possible that the controller 120 transmits acontrol signal to the external device through the communication unit 160to control the external device in accordance with the control signal ofthe controller.

For example, the external device may be configured to process data ofthe external device in accordance with the control signal of thecontroller received through the communication unit.

A program (such as artificial intelligence) capable of controlling theultrasound diagnosis apparatus 100 may be installed in the externaldevice, such that the program may include instructions for performingsome or all of the operations of the controller 120.

The program may be preinstalled in the external device or may beinstalled by downloading, by a user of the external device, the programfrom a server that provides an application. The server providing theapplication may include a recording medium in which the correspondingprogram is stored.

In addition, the program may include a storage medium of a server or astorage medium of a client device in a system consisting of a server anda client device. Alternatively, if there is a third device (smartphones,tablet PCs, wearable devices, etc.) that is communicatively connected tothe server or client device, the program product may include a storagemedium of the third device. Alternatively, the program may include a S/Wprogram itself transmitted from the server to the client device or thethird device, or transmitted from the third device to the client device.

In this case, one of the server, the client device, and the third devicemay execute the program to perform the methods according to thedisclosed embodiments. Alternatively, the client device may perform themethod according to the disclosed embodiments via the server.

Alternatively, two or more of the server, the client device, and thethird device may execute the program for perform the methods accordingto the disclosed embodiments by distributing the methods.

For example, a server (e.g., a cloud server or an artificialintelligence server, etc.) may be configured to execute a program storedin the server, so as to control the client device that iscommunicatively connected to the server to perform the methods accordingto the disclosed embodiments.

The storage 150 may be configured to store various data or programs fordriving and controlling the ultrasound diagnosis apparatus 100,input/output ultrasound data, and an ultrasound image.

The input unit 170 may be configured to receive a user input forcontrolling the ultrasound diagnosis apparatus 100. For example, theuser input may include an input for manipulating a button, a keypad, amouse, a trackball, a jog switch, a knob, etc., an input for touching atouch pad or a touch screen, a voice input, a motion input, and an inputof biometric information (e.g., iris recognition, fingerprintrecognition, etc.), but is not limited thereto.

FIG. 3 is a block diagram illustrating a configuration of the ultrasounddiagnosis apparatus 100 in accordance with any one embodiment of thepresent disclosure.

Referring to FIG. 3 , the ultrasound diagnosis apparatus 100 may includea probe 20, an ultrasonic transceiver 110, a controller 120, an imageprocessor 130, a display unit 140, an input unit 170, a storage 150, anda communication unit 160.

The probe 20 according to an embodiment of the present disclosure mayinclude a plurality of transducers. The plurality of transducers may bearranged in two dimensions to form a 2D transducer array.

For example, the 2D transducer array may have a form including aplurality of sub-arrays including a plurality of transducers arranged ina first direction and in a second direction different from the firstdirection.

Further, the ultrasonic transceiver 110 may include an analog beamformer116 a and a digital beamformer 116 b. Though the ultrasonic transceiver110 and the probe 20 are illustrated as having a separate configurationin FIG. 3 , the probe 20 according to an embodiment of the presentdisclosure may include partial or entire configuration of ultrasonictransceiver 110 according to the implementation form. For example, theprobe 20 may include one or both of the analog beamformer 116 a and thedigital beamformer 116 b.

The controller 120 may be configured to calculate a time delay value fordigital beamforming for each sub-array with respect to each of theplurality of sub-arrays included in the 2D transducer array. Further,the controller 120 may be configured to calculate a time delay value foranalog beamforming with respect to each of the transducers included inany one of the plurality of sub-arrays.

The controller 120 may be configured to control, according to the timedelay value for analog beamforming and the time delay values for digitalbeamforming, the analog beamformer 116 a and the digital beamformer 116b to generate a transmission signal to be transmitted to each of theplurality of transducers.

Further, the controller 120 may be configured to control the analogbeamformer 116 a to sum up the signals received from the plurality oftransducers for each sub-array according to the time delay value foranalog beamforming. In addition, the controller 120 may be configured tocontrol the ultrasonic transceiver 110 to convert the signal summed foreach sub-array from analog to digital. In addition, the controller 120may be configured to control the digital beamformer 116 b to generateultrasound data by summing the digitally converted signals according tothe time delay value for digital beamforming.

The image processor 130 is configured to generate an ultrasound imageusing the generated ultrasound data.

The display unit 140 may be configured to display the generatedultrasound image and various information processed in the ultrasounddiagnosis apparatus 100. The ultrasound diagnosis apparatus 100 mayinclude one or a plurality of display units 140 according to animplementation form. In addition, the display unit 140 may be providedas a touch screen in combination with a touch panel.

The controller 120 may be configured to control the overall operation ofthe ultrasound diagnosis apparatus 100 and the signal flow among theinternal components in the ultrasound diagnosis apparatus 100. Thecontroller 120 may include a memory configured to store a program ordata for performing a function of the ultrasound diagnosis apparatus 100and a processor configured to process a program or data. Further, thecontroller 120 may be configured to receive a control signal from theinput unit 170 or the external device to control the operation of theultrasound diagnosis apparatus 100.

The ultrasound diagnosis apparatus 100 may include the communicationunit 160 and be connected with the external device (e.g., a server, amedical device, a portable device (smartphones, tablet PCs, wearabledevices, etc.)) through the communication unit 160.

The communication unit 160 may include one or more components thatenable communication with the external device, including, for example,at least one of short-range communication modules, wired communicationmodules and wireless communication modules.

It is possible that the communication unit 160 receives a control signaland data from the external device and transmits the received controlsignal to the controller 120 so as to have the controller 120 controlthe ultrasound diagnosis apparatus 100 according to the received controlsignal.

Alternatively, it is also possible that the controller 120 transmits thecontrol signal to the external device through the communication unit 160to control the external device according to the control signal of thecontroller.

For example, the external device may be configured to process data ofthe external device according to the control signal of the controllerreceived through the communication unit.

A program (such as artificial intelligence) capable of controlling theultrasound diagnosis apparatus 100 may be installed in the externaldevice, such that the program may include instructions for performingsome or all of the operations of the controller 120.

The program may be preinstalled in the external device or may beinstalled by downloading, by a user of the external device, the programfrom a server that provides an application. The server providing theapplication may include a recording medium in which the correspondingprogram is stored.

In addition, the program may include a storage medium of a server or astorage medium of a client device in a system consisting of a server anda client device. Alternatively, if there is a third device (smartphones,tablet PCs, wearable devices, etc.) that is communicatively connected tothe server or client device, the program product may include a storagemedium of the third device. Alternatively, the program may include a S/Wprogram itself transmitted from the server to the client device or thethird device, or transmitted from the third device to the client device.

In this case, one of the server, the client device, and the third devicemay execute the program to perform the methods according to thedisclosed embodiments. Alternatively, two or more of the server, theclient device, and the third device may execute the program to performthe methods according to the disclosed embodiments by distributing themethods.

For example, a server (e.g., a cloud server or an artificialintelligence server, etc.) may be configured to execute a program storedin the server, so as to control the client device that iscommunicatively connected to the server to perform the methods accordingto the disclosed embodiments.

The storage 150 may be configured to store various data or programs fordriving and controlling the ultrasound diagnosis apparatus 100,input/output ultrasound data, and an ultrasound image.

The input unit 170 may be configured to receive a user input forcontrolling the ultrasound diagnosis apparatus 100. For example, theuser input may include an input for manipulating a button, a keypad, amouse, a trackball, a jog switch, a knob, etc., an input for touching atouch pad or a touch screen, a voice input, a motion input, and an inputof biometric information (e.g., iris recognition, fingerprintrecognition, etc.), but is not limited thereto.

FIGS. 4A to 4C are perspective views of an ultrasound diagnosisapparatus 200 in accordance with at least one embodiment of the presentdisclosure.

Referring to FIGS. 4A and 4B, the ultrasound diagnosis apparatuses 200 aand 200 b may include a main display unit 221 and a sub-display unit222. One of the main display unit 221 and the sub-display unit 222 maybe provided as a touch screen. The main display unit 221 and thesub-display unit 222 may be configured to display an ultrasound image orvarious information processed in the ultrasound diagnosis apparatuses200 a and 200 b. In addition, the main display unit 221 and thesub-display unit 222 may be provided as a touch screen, and by providinga GUI, data for controlling the ultrasound diagnosis apparatuses 200 aand 200 b may be received from a user. For example, the main displayunit 221 may be configured to display an ultrasound image, and thesub-display unit 222 may be configured to display a control panel forcontrolling the display of the ultrasound image in the form of a GUI.The sub-display unit 222 may be input with data for controlling thedisplay of an image through a control panel displayed in the form of aGUI. The ultrasound diagnosis apparatuses 200 a and 200 b may beconfigured to control the display of the ultrasound image displayed onthe main display unit 221 by using the received control data.

Referring to FIG. 4B, the ultrasound diagnosis apparatus 200 b mayfurther include a control panel 265 in addition to the main display unit221 and the sub-display unit 222. The control panel 265 may include abutton, a trackball, a jog switch, and a knob, and may be input withdata for controlling the ultrasound diagnosis apparatus 200 b from auser. For example, the control panel 265 may include a time gaincompensation (TGC) button 271, and a freeze button 272. The TGC button271 is a button for setting a TGC value for each depth of the ultrasoundimage. Further, when an input of the freeze button 272 is sensed whilescanning the ultrasound image, the ultrasound diagnosis apparatus 200 bmay maintain a state in which a frame image at a corresponding moment isdisplayed.

Meanwhile, the button, the track ball, the jog switch and the knobincluded in the control panel 265 may be provided to the main displayunit 221 or the sub-display unit 222 as a GUI.

Referring to FIG. 4C, the ultrasound diagnosis apparatus 200 c may beimplemented as a portable type. Examples of the portable ultrasounddiagnosis apparatus 200 c may include smart phones, laptop computers,PDAs, and tablet PCs including a probe and an application, but are notlimited thereto.

The ultrasound diagnosis apparatus 200 c may include the probe 20 and amain body 240, and the probe 20 may be connected to one side of the mainbody 240 by a wire or wirelessly. The main body 240 may include a touchscreen 245. The touch screen 245 may be configured to display anultrasound image, various information processed in the ultrasounddiagnosis apparatus, and a GUI.

FIGS. 5A to 5C are perspective views of an ultrasound diagnosisapparatus 500 in accordance with at least one embodiment of the presentdisclosure.

Referring to FIG. 5A, the ultrasound diagnosis apparatus used indoors oran indoor ultrasound diagnosis apparatus 500 generally refers to anon-portable ultrasound diagnosis apparatus used for ultrasounddiagnosis, and such an ultrasound diagnosis apparatus 500 is also calledcart base equipment. Although the ultrasound diagnosis apparatus 500 isnot necessarily used only indoors, it will be referred to as an indoorultrasound diagnosis apparatus 500 for convenience.

The indoor ultrasound diagnosis apparatus 500 may have a portabledocking unit 580 connected to a portable ultrasound diagnosis apparatus400, and since all components except for the portable docking unit 580of the indoor ultrasound diagnosis apparatus 500 used in an embodimentof the present disclosure are generally used, a detailed descriptionthereof will be omitted.

Unlike the portable ultrasound diagnosis apparatus 400, the indoorultrasound diagnosis apparatus 500 has fewer restrictions in terms ofsize, weight, power consumption, etc., so that diagnosable area isdiverse, and it may be developed with high performance. When theportable ultrasound diagnosis apparatus 400 is mounted onto the indoorultrasound diagnosis apparatus 500, it is possible to use the portableultrasound diagnosis apparatus 400 with high performance. However, theposition at which the portable ultrasound diagnosis apparatus 400 ismounted on the indoor ultrasound diagnosis apparatus 500 may be anywherewith no limitation where it is convenient for the user to use theportable ultrasound diagnosis apparatus 400 and the indoor ultrasounddiagnosis apparatus 500 at the same time, and it is not limited by FIG.5A. Furthermore, the portable ultrasound diagnosis apparatus 400 may beconnected to the indoor ultrasound diagnosis apparatus 500 through awire or integrally.

Referring to FIGS. 5A and 5B, the portable ultrasound diagnosisapparatus 400 in FIG. 5A may correspond to a portable ultrasounddiagnosis apparatus 201 in FIG. 5B.

It may be integrated with a probe (not shown) including a plurality oftransducer elements. Specifically, the portable ultrasound diagnosisapparatus 400 refers to an apparatus that is connected to the indoorultrasound diagnosis apparatus 500 using a wireless or wiredcommunication method (including Universal Serial Bus (USB)) to providean ultrasound image to the user using received ultrasound image data.For example, the portable ultrasound diagnosis apparatus 400 may be asmart device in which an application is downloaded and installed in asmart phone.

Specifically, the portable ultrasound diagnosis apparatus 400 may be anapparatus that is connected to the indoor ultrasound diagnosis apparatus500 through a wired or wireless communication method to provide anultrasound image to the user using the received ultrasound image data.

For example, the wireless communication method may include at least oneof short-range data communication methods including a 60 GHz (mmWave)wireless local area network (WLAN). It may be local area network(Wi-Fi), Bluetooth, ZigBee, Wi-Fi Direct (WFD), Infrared DataAssociation (IrDA), Bluetooth Low Energy (BLE), Near Field Communication(NFC), Wireless Broadband Internet (Wibro), globally interoperableShared Wireless Access Protocol (SWAP) for Microwave Access (WiMAX),Wireless Gigabit Alliance (WiGig), and radio frequency (RF).

FIG. 5B illustrates an ultrasound diagnosis system in which the portableultrasound diagnosis apparatus 201 is connected to a cart-basedultrasound diagnosis apparatus 500.

The cart-based ultrasound diagnosis apparatus 500 may be connected tothe portable ultrasound diagnosis apparatus 201 using the aforementionedwireless communication method. Specifically, the portable ultrasounddiagnosis apparatus 201 may include at least one wireless communicationmodule (not shown) for performing at least one of the aforementionedwireless communication methods. Furthermore, a portable docking unit 580in the cart-based ultrasound diagnosis apparatus 500 may include atleast one wireless communication module (not shown) for performingwireless communication with the portable ultrasound diagnosis apparatus201.

In this case, the wireless communication module in the cart-basedultrasound diagnosis apparatus 500 may be a module for performingcommunication according to at least one of the aforementioned wirelesscommunication methods.

FIG. 5C illustrates an ultrasound diagnosis system in which the portableultrasound diagnosis apparatus 202 is connected to the cart-basedultrasound diagnosis apparatus 500.

The portable ultrasound diagnosis apparatus 202 may be coupled to theprobe 301 through a probe port. The portable ultrasound diagnosisapparatus 202 may be configured to generate an ultrasound image by usingthe ultrasound image corresponding to the ultrasound signal received bythe probe 301 to display the ultrasound image on the display unit.

The cart-based ultrasound diagnosis apparatus 500 may be connected tothe portable ultrasound diagnosis apparatus 202 using the aforementionedwireless communication method. The connection through wirelesscommunication between the cart-based ultrasound diagnosis apparatus 500and the portable ultrasound diagnosis apparatus 202 corresponds to theconnection between the cart-based ultrasound diagnosis apparatus 500 andthe portable ultrasound diagnosis apparatus 201, and thus a detaileddescription thereof will be omitted.

Hereinafter, an embodiment of an ultrasound remote diagnosis systemapplicable to at least one of the ultrasound diagnosis apparatusesdescribed with reference to FIGS. 1 to 3 will be described.

FIG. 6A is a diagram for explaining a conventional ultrasound remotediagnosis system.

The conventional ultrasound remote diagnosis system illustrated in FIG.6A may be configured to transmit only a portion corresponding to themain panel of the ultrasound apparatus main body to a monitor at aremote location, so that only the main panel on which an ultrasoundimage is displayed may be displayed on the monitor at a remote location.In this case, portions corresponding to the touch panel and the controlpanel, which are one component of the ultrasound apparatus main body,are not displayed on the remote monitor.

FIG. 6B is a diagram for explaining a conventional ultrasound remotediagnosis system.

The conventional ultrasound remote diagnosis system shown in FIG. 6B isa system in which parts corresponding to the main panel, touch panel,and control panel of the ultrasound apparatus are all displayed on aremote monitor, which is a mirroring technology that transmits the mainpanel, touch panel, and control panel as one signal to the monitor of aremote device.

It is a method in which the entire image displayed on the main bodymonitor is transmitted at once while the main panel, the touch panel,and the control panel corresponding to the ultrasound image aredisplayed on the monitor of the ultrasound apparatus main body. In theconventional system of FIG. 6B, while all three screens of the mainpanel, the touch panel, and the control panel are displayed on themonitor of the remote device, in a state in which the screencorresponding to the main panel is displayed on the entire remotemonitor, the screens corresponding to the touch panel and the controlpanel are displayed in a overlapped form.

It is a technology in which three pieces of information are transmittedas one signal, and since the screen may only be displayed in the form ofoverlapping screens on the monitor of the remote device, the user cannotsee the entire screen corresponding to the main panel, which isinconvenient for diagnosis. This is because, in order to confirm theultrasound image, the diagnosis must be performed while moving theultrasound image to a position that does not overlap the screenscorresponding to the touch panel and the control panel.

An ultrasound remote diagnosis system 700 and a diagnosis methodaccording to the present disclosure are intended to improve the aboveinconvenience and will be described below.

FIG. 7A is a diagram for explaining the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

As illustrated in FIG. 7A, the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure includes a mainbody 710 including a main panel 712, a touch panel 714, and a controlpanel 716, and a remote device 720 in communication with the main body710.

The remote device 720 is configured to independently receive, amongdisplay data which is real-time image information of the main panel 712,first control data which is real-time image information of the touchpanel 714, and second control data which is a virtual control panelcorresponding to the control panel 716, at least each informationcorresponding to the display data and the first control data, from themain body 710, and display a display part 722, a first controller 724,and a second controller 726 respectively corresponding to the displaydata, the first control data, and the second control data so as not tooverlap, and the main body 710 is configured to, in a measurement modefor measuring an object based on a marker set in an ultrasound imagedisplayed on the main panel 712, receive the marker information formeasurement input to at least one of the display part 722, the firstcontroller 724, and the second controller 726 of the remote device 720and display on the main panel 712.

According to another embodiment of the present disclosure, theultrasound remote diagnosis system 700 includes a remote device 720 incommunication with a main body 710 including a main panel 712, a touchpanel 714, and a control panel 716.

The remote device 720 independently receives, among display data whichis real-time image information of the main panel 712, first control datawhich is real-time image information of the touch panel 714, and secondcontrol data which is a virtual control panel corresponding to thecontrol panel 716, at least each information corresponding to thedisplay data and the first control data, from the main body 710, anddisplay a display part 722, a first controller 724, and a secondcontroller 726 respectively corresponding to the display data, the firstcontrol data, and the second control data so as not to overlap, and in ameasurement mode for measuring an object based on a marker set in anultrasound image displayed on the main panel 712, the marker informationfor measurement input to at least one of the display part 722, the firstcontroller 724, and the second controller 726 is transmitted to the mainbody 710 to be displayed on the main panel 712.

According to another embodiment of the present disclosure, theultrasound remote diagnosis system 700 includes a main body 710 incommunication with a remote device 720.

In order for the remote device 720 to display a display part 722, afirst controller 724, and a second controller 726 respectivelycorresponding to display data which is real-time image information ofthe main panel 712, first control data which is real-time imageinformation of the touch panel 714, and second control data which is avirtual control panel corresponding to the control panel 716, so as notto overlap, the main body 710 independently transmits, among the displaydata, the first control data and the second control data, at least eachinformation corresponding to the display data and the first controldata, to the remote device 720, and in a measurement mode for measuringan object based on a marker set in an ultrasound image displayed on themain panel 712, the marker information for measurement input to at leastone of the display part 722, the first controller 724, and the secondcontroller 726 is received by the main body 710 to be displayed on themain panel 712.

In FIGS. 6A and 6B described above, while information corresponding tothe main panel, touch panel, and control panel of the conventional mainbody was transmitted to a remote device in the form of a single signal,unlike this, in the ultrasound remote diagnosis system 700 according tothe present disclosure, information corresponding to the main panel 712,the touch panel 714, and the control panel 716 of the main body 710 aretransmitted to the remote device 720 as separate signals, andaccordingly, each of the display part 722, the first controller 724, andthe second controller 726 may be displayed on the remote device 720without overlapping and may be independently controlled.

In the present disclosure, information corresponding to the main panel712, the touch panel 714, and the control panel 716 of the main body 710are transmitted to the remote device 720 as separate signals toindependently control each of the display part 722, the first controller724, and the second controller 726 in the remote device 720, andaccording to another embodiment, after being transmitted so as tooverlap, they may be independently resized and displayed so as not tooverlap.

The remote device 720 may include a monitor and, depending on theembodiment, may include a virtual monitor type such as AR/VR/MR.

The ultrasound scan screen may be displayed on the display part 722 inreal time, and the first controller 724 corresponding to the real-timeimage of the touch panel 714 may be displayed as a moving picture.

For reference, in the case of the prior art in which the control panelitself is a touch panel, the main panel corresponds to a vertical type.In this case, as described above, the transmission method from the mainbody to the remote device in the prior art is to transmit the entirescreen of the main body as one signal, and the entire screen displayedon the main body has no choice but to be integrated and moved, so themain panel and control panel are transmitted as they are arrangedvertically. The monitor of the remote device is generally of ahorizontal type, and in this case, it is difficult to display thevertical type arranged on the main body as it is, and even if it isdisplayed, there was a problem that the screen is small or cut off.

The present disclosure is a technology characterized in that the mainpanel 712, the touch panel 714, and the control panel 716 of the mainbody 710 are each independently transmitted as separate signals to theremote device 720, and regardless of whether the main body 710 and theremote device 720 are horizontal or vertical, there is an advantage inthat a complete screen may be easily displayed.

The second controller 726 in the present disclosure is a virtual controlpanel corresponding to the control panel 716 of the main body 710 andmay have the same shape as the actual control panel 716 of the main body710. Specifically, the screen displayed on the second controller 726 ismatched to the control panel 716, which is the hardware of the actualmain body 710, and the virtual control panel having shapes and functionsmatching the buttons provided in the control panel 716 and the functionsby the buttons may be displayed.

In other words, the same shape as that of the control panel 716 may bedisplayed on the second controller 726 based on the second control datathat is information about the control panel 716 model.

In the remote device 720 of the present disclosure, each screen of thedisplay part 722, the first controller 724, and the second controller726 is displayed separately, which is convenient for image manipulationor viewing detailed screens.

In the present disclosure, the user may manipulate the first controller724 and the second controller 726 displayed on the remote device 720 byusing the remote mouse 750.

The first controller 724 may be clicked with the remote mouse 750, andat this time, the input value through the remote mouse 750 is changed torelative position information on the screen and transmitted to the mainbody 710 so that the operation may be performed.

In addition, the second controller 726 may be manipulated by clicking ordragging, or may be manipulated using a mouse wheel.

For example, in the case of a configuration in which the manipulationconfiguration of the control panel 716 of the main body 710 is amanipulation method of rotating in the + and − directions, as amanipulation method of the second controller 726 displayed on the remotedevice 720, parts marked with + and − may be clicked with the remotemouse 750 and manipulated. Alternatively, the configuration actuallyrotated in the control panel 716 may be rotated by a drag method usingthe remote mouse 750 in the remote device 720, and + and − may bemanipulated according to the direction in which the wheel is rolled.

Manipulation buttons and manipulation contents frequently used by theuser may be designated in advance to specific keys on the remotekeyboard 760, and may be used as shortcut keys.

The measurement mode means measuring an object included in an ultrasoundimage, and in the measurement mode, an object to be measured may bemeasured based on a marker displayed on an ultrasound image. The markerswill be described with reference to FIGS. 10A to 10D and FIGS. 11A to11I below.

One or more remote devices 720 capable of remote access to the main body710 may be provided, and hereinafter, the case where there is one remotedevice 720 has been described, but when there are a plurality of remotedevices 720, the same method may be used.

FIG. 7B is a diagram for explaining an ultrasound remote diagnosissystem 700 in accordance with another embodiment of the presentdisclosure.

FIG. 7B illustrates a case where the monitor of the remote device 720 isa dual monitor consisting of a first monitor and a second monitor, andin this case, the display part 722 may be displayed on the firstmonitor, and the first controller 724 and the second controller 726 maybe displayed on the second monitor.

The monitor of the remote device 720 according to the present disclosuremay be of a horizontal type having a longer horizontal length comparedto vertical as shown in FIGS. 7A and 7B, but may also be of a verticaltype having a long vertical length.

In the case of a vertical monitor, the display part 722 may be displayedon the upper side of the monitor of the remote device 720, and the firstcontroller 724 and the second controller 726 may be displayed on thelower side of the monitor of the remote device 720, and conversely, thedisplay part 722 may be disposed on the lower side, and the firstcontroller 724 and the second controller 726 may be disposed on theupper side for display.

The position of each screen displayed on the monitor of the remotedevice 720 is not limited to the above-described positions, and mayinclude all cases where the screen is displayed without overlappingportions on the screen.

FIG. 8 is a diagram for explaining a measurement mode of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

As shown in FIG. 8 , in the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure, in the measurementmode, information input to the display part 722 may be transmitted tothe main body 710 and may be displayed on the main panel 712.

In the present disclosure, the touch panel 714 and the first controller724, the control panel 716 and the second controller 726 may eachindependently perform two-way transmission and reception. However, incase of non-measurement mode, between the main panel 712 of the mainbody 710 and the display part 722 of the remote device 720, only one-wayinformation transmission is possible from the main panel 712 of the mainbody 710 to the display part 722 of the remote device 720.

On the other hand, in the measurement mode, as shown in FIG. 8 , themain panel 712 of the main body 710 and the display part 722 of theremote device 720 may transmit and receive information in bothdirections.

The ultrasound remote diagnosis system 700 according to the presentdisclosure can execute the measurement mode by controlling the mainpanel 712 of the main body 710 or by touching the touch panel 714, andin addition, it is possible to execute the measurement mode through theremote device 720. Execution of the measurement mode through the remotedevice 720 will be described with reference to FIGS. 9A to 9C below.

In the measurement mode, the measurement process performed through themain body 710 and the remote device 720 may be displayed equally on themain panel 712 of the main body 710 and the display part 722 of theremote device 720.

When the ultrasound remote diagnosis system 700 of the presentdisclosure enters the measurement mode, a first pointer (not shown)corresponding to the mouse cursor of the main body 710 may be displayedon the display part 722, a second pointer 740 corresponding to the mousecursor of the remote device 720 may be displayed, or both the firstpointer (not shown) and the second pointer 740 may be displayed.

When there are a plurality of remote devices 720, each remote device 720may independently execute a measurement mode.

In this case, the measuring process may be displayed not only on theremote device 720 that performs the measurement, but also on otherremote devices 720. When measurement is performed simultaneously in aplurality of remote devices 720, a display method and a display orderare not limited herein.

FIG. 9A is a diagram for explaining a process of executing a measurementmode of the ultrasound remote diagnosis system 700 in accordance with anembodiment of the present disclosure.

In the ultrasound remote diagnosis system 700 of the present disclosure,in order to execute the measurement mode, the measurement mode mustfirst be started, and the starting of the measurement mode may be thesame as the method of starting the measurement mode in the existingultrasound apparatus.

In the present disclosure, before the user executes the measurementmode, the user must enter the measurement mode, so in a state in whichthe measurement mode is entered, measurement may be performed throughthe same operation as in the description of FIGS. 9A to 9C below.

In the ultrasound remote diagnosis system 700 according to an embodimentof the present disclosure, a distance to be measured, a line trace, acircumference, a thickness, an area, a volume, etc., of an object to bemeasured may be measured through the measurement modes for the variousmodes described above.

The types of measurement modes are not limited to those listed above andmay include all of various measurement modes utilized in the ultrasoundapparatus.

Execution of the measurement mode in the present disclosure may beperformed through the control of the second controller 726, and as anembodiment, as shown in FIG. 9A, it may be executed by pressing the‘measurement’ button located on the second controller 726.

As another embodiment, the measurement mode may be executed only bymoving the second pointer 740, which will be described with reference toFIGS. 9B and 9C.

FIGS. 9B and 9C are a diagram for explaining a process of executing ameasurement mode of the ultrasound remote diagnosis system 700 inaccordance with an embodiment of the present disclosure.

FIG. 9B is a state in which the second pointer 740 is located in thearea of the second controller 726, and FIG. 9C is a state in which thesecond pointer 740 is moved to the display part 722.

As shown in FIG. 9C, the measurement mode may be executed by moving thesecond pointer 740 inside an area of the display part 722, i.e., insidethe image area 730 where an image is displayed.

In the measurement mode, since the main panel 712 of the main body 710and the display part 722 of the remote device 720 may transmit andreceive information in both directions, measurement in the measurementmode may use at least one of a first pointer (not shown) and a secondpointer 740.

Since the measurement method using a first pointer (not shown)corresponding to the mouse cursor of the main body 710 is similar to themeasurement method in a general ultrasound apparatus, hereinafter, ameasurement method using the second pointer 740 corresponding to themouse cursor of the remote device 720 will be described.

FIGS. 10A to 10D are a diagram for explaining a remote measurementprocess in the ultrasound remote diagnosis system 700 in accordance withan embodiment of the present disclosure.

First, as shown in FIGS. 10A to 10D, when the second pointer 740corresponding to the mouse cursor of the remote device 720 is locatedwithin the area of the display part 722, the second pointer 740 may beexpressed in the form of measurement markers 742 and 744.

A first measurement marker 742 is displayed at the point where thesecond pointer 740 is located, a first point 743 is specified byclicking the first measurement marker 742, and when the second pointer740 moves, a second measurement marker 744 is displayed at the movedlocation, and the second point 745 may be specified by clicking thesecond measurement marker 744.

In the present disclosure, the second pointer 740 may be moved bymanipulating the remote mouse 750, and the remote trackball 727 of thesecond controller 726, which is a virtual control panel, may be easilymanipulated by manipulating the remote mouse 750.

Looking at the measurement process through FIGS. 10A to 10D, FIG. 10A isa view in which the second pointer 740 is moved to the starting locationfor measuring the object in order to measure the object located in thedisplay part 722, which is a state where the first measurement marker742 is displayed at the point where the second pointer 740 is located.As the location of the second pointer 740 is moved, the firstmeasurement marker 742 is moved to coincide with the second pointer 740.

FIG. 10B illustrates a view in which the second pointer 740 is locatedat a specific location of an object to be measured, i.e., a startinglocation for measurement, and clicked, and accordingly, the pointindicated by the first measurement marker 742 and the starting locationfor measurement may be specified as the first point 743.

FIG. 10C illustrates that the second pointer 740 is moved to the endlocation for measuring the object after specifying the first point 743,which is a view in which the second measurement marker 744 is displayedon the moved second pointer 740. While the second pointer 740 is movedby the user, the second measurement marker 744 may be continuouslydisplayed on the second pointer 740 together.

In the present disclosure, in the process of measuring the objectthrough the remote device 720, there is an advantage in that the usermay specify the first point 743 and the second point 745 while watchingthe location of each of the measurement markers 742 and 744 move.

FIG. 10D illustrates a state in which the second pointer 740 is clickedwhile the second pointer 740 is located at the end location formeasurement, and the point indicated by the second measurement marker744 may be specified as a second point 745.

According to an embodiment, a connection line connecting the first point743 and the second point 745 may be displayed, and the connection lineis displayed on the screen, thereby having the effect of accuratemeasurement.

In the measurement mode according to the present disclosure, when thesecond pointer 740 moves, the user may see the first measurement marker742 and the second measurement marker 744 displayed while movingtogether, and since it is possible to specify while seeing anddetermining the location to be measured, it is easy to measure comparedto the existing one.

In addition, in the present disclosure, when the second pointer 740 islocated on the image area 730 of the display part 722, measurementmarkers 742 and 744 appear, and when specifying a measurement point,there is no need to move the second pointer 740 again to press aseparate button, and the point to be measured is specified simply byplacing the second pointer 740 on the point to be specified andclicking, so which is easier than the existing measurement method.

In other words, in the present disclosure, for specifying a point, afterlocating the second pointer 740 at the first point 743 and the secondpoint 745, when the remote mouse 750 is clicked as it is, the processmay be the same as clicking the SET/EXIT button located in the secondcontroller 726 of the remote device 720 corresponding to the controlpanel 716 of the main body 710.

In contrast, in the existing measurement method, the measurement markerdoes not appear immediately on the mouse cursor even when the mousecursor is placed on the image area, but the measurement marker appearedon the mouse cursor only when there is a separate action of clicking themouse cursor.

In particular, in the process of moving the mouse cursor to the object,since it was possible to move the pointer through mouse drag only withinthe trackball area on the virtual control panel displayed on the remotemonitor, when the object to be measured is larger than the diameter ofthe trackball, there was inconvenience of moving the measurement markerby dragging the mouse several times. In addition, by moving the mousepointer in the trackball according to the above description, afterlocating the measurement marker on the object, in order to specify thefirst point and the second point, the SET button displayed on the remotemonitor screen corresponding to the control panel of the main bodyshould have been clicked, respectively, so the existing method is anindirect measurement method rather than a direct measurement on theimage of the object, which causes inconvenience.

FIGS. 11A to 11I are a diagram illustrating various embodiments ofmeasurement markers 742, 744 and a second pointer 740 in an ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

As illustrated in FIGS. 11A to 11I, size, shape, and the like of thesecond pointer 740, the measurement markers 742 and 744, and theconnection line connecting the first point 743 and the second point 745may vary.

The ultrasound remote diagnosis method according to an embodiment of thepresent disclosure is an ultrasound remote diagnosis method of anultrasound remote diagnosis system including a main body 710 including amain panel 712, a touch panel 714, and a control panel 716, and a remotedevice 720 in communication with the main body 710.

The method includes independently receiving, by the remote device 720,among display data which is real-time image information of the mainpanel 712, first control data which is real-time image information ofthe touch panel 714, and second control data which is a virtual controlpanel corresponding to the control panel, at least each informationcorresponding to the display data and the first control data, from themain body 710, displaying, by the remote device 720, a display part 722,a first controller 724, and a second controller 726 respectivelycorresponding to the display data, the first control data, and thesecond control data so as not to overlap, and in a measurement mode formeasuring an object based on a marker set in an ultrasound imagedisplayed on the main panel 712, receiving, by the main body 710, themarker information for measurement input to at least one of the displaypart 722, the first controller 724, and the second controller 726 todisplay on the main panel 712.

Executing the measurement mode by moving the second pointer 740 insidethe area of the display part 722 or by controlling the second controlunit 726 may be further included.

In the measurement mode, at least one of a first pointer (not shown)corresponding to a mouse cursor of the main body 710 and a secondpointer 740 corresponding to a mouse cursor of the remote device 720 maybe displayed on the display part 722, and displaying measurement markers742 and 744 on the second pointer 740 when the second pointer 740 islocated within the object area may be included.

In the measurement mode, specifying the first point 743 by clicking thefirst measurement marker 742 displayed at the point where the secondpointer 740 is located, and specifying the second point 745 by clickingthe second measurement marker 744 displayed at the location where thesecond pointer 740 moves may be included.

Depending on embodiments, displaying a connection line connecting thefirst point 743 and the second point 745 may be included.

According to an embodiment, the ultrasound diagnosis apparatus accordingto the present disclosure may be applied not only to an ultrasoundapparatus, but also to a diagnostic field performed together with amedical imaging device such as a magnetic resonance imaging (MRI)device, a computed tomography (CT) device, or an X-ray imaging device.

Since detailed information related to each step has been sufficientlydescribed in relation to the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure, a detaileddescription thereof will be omitted.

The remote measurement method of the ultrasound remote diagnosis system700 according to an embodiment of the present disclosure has beendescribed above, and hereinafter, a remote display method of theultrasound remote diagnosis system 700 according to an embodiment of thepresent disclosure will be described.

In the case of the conventional ultrasound remote diagnosis, when thecontrol panel of the main body is manipulated, the manipulation processfor which manipulation is in progress is not displayed on the monitor ofthe remote device, but only the result of the manipulation was shown.

Therefore, the control panel manipulation process in the main body couldnot be known at the remote location, so the diagnosis process had to beguessed only through the image of the manipulation result during theultrasound diagnosis process. In this regard, there were somedifficulties in the process of remotely learning to manipulate theultrasound diagnosis system.

The present disclosure is to improve the difficulty of the existingultrasound remote diagnosis method as described above, and ischaracterized in that the manipulation process of the control panel 716of the main body 710 is displayed on the remote device 720.

At the same time, in the present disclosure, the manipulation process ofthe second controller 726 of the remote device 720 may be displayed onthe control panel 716 of the main body 710, which is significant thatwhen there are a plurality of second controllers 726, the manipulationprocess of each second controller 726 may be checked from the main body710.

FIG. 12A is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure, and FIG. 12B is a diagram for explaining a displaymethod of the ultrasound remote diagnosis system 700 in accordance withanother embodiment of the present disclosure.

As illustrated in FIGS. 12A and 12B, an ultrasound remote diagnosissystem 700 according to an embodiment of the present disclosure includesa main body 710 including a main panel 712, a touch panel 714, and acontrol panel 716, and a remote device 720 in communication with themain body 710, wherein the remote device 720 is configured toindependently receive, among display data which is real-time imageinformation of the main panel 712, first control data which is real-timeimage information of the touch panel 714, and second control data whichis a virtual control panel corresponding to the control panel 716, atleast each information corresponding to the display data and the firstcontrol data, from the main body 710, and display a display part 722, afirst controller 724, and a second controller 726 respectivelycorresponding to the display data, the first control data, and thesecond control data so as not to overlap, and in order for manipulationinformation by any one of the control panel 716 and the secondcontroller 726 to be displayed on the other one, the manipulationinformation is transmitted mutually between the main body 710 and theremote device 720.

According to another embodiment of the present disclosure, an ultrasoundremote diagnosis system 700 includes a remote device 720 incommunication with a main body 710 including a main panel 712, a touchpanel 714, and a control panel 716, wherein the remote device 720 isconfigured to independently receive, among display data which isreal-time image information of the main panel 712, first control datawhich is real-time image information of the touch panel 714, and secondcontrol data which is a virtual control panel corresponding to thecontrol panel 716, at least each information corresponding to thedisplay data and the first control data, from the main body 710, anddisplay a display part 722, a first controller 724, and a secondcontroller 726 respectively corresponding to the display data, the firstcontrol data, and the second control data so as not to overlap, and inorder for manipulation information by any one of the control panel 716and the second controller 726 to be displayed on the other one, themanipulation information is transmitted mutually between the main body710 and the remote device 720.

According to another embodiment of the present disclosure, an ultrasoundremote diagnosis system 700 includes a main body 710 in communicationwith a remote device 720, wherein the main body 710 includes a mainpanel 712, a touch panel 714, and a control panel 716, and a remotedevice 720, in order for the remote device 720 to display a display part722, a first controller 724, and a second controller 726 respectivelycorresponding to display data which is real-time image information ofthe main panel 712, first control data which is real-time imageinformation of the touch panel 714, and second control data which is avirtual control panel corresponding to the control panel 716, so as notto overlap, the main body 710 independently transmits, among the displaydata, the first control data and the second control data, at least eachinformation corresponding to the display data and the first controldata, to the remote device 720, and in order for manipulationinformation by any one of the control panel 716 and the secondcontroller 726 to be displayed on the other one, the manipulationinformation is transmitted mutually between the main body 710 and theremote device 720.

In the present disclosure, manipulation information by the control panel716 may be displayed on the second controller 726 in real time, and themanipulation information by the second controller 726 may be displayedon the control panel 716 in real time.

As illustrated in FIG. 12A, there may be one remote device 720 capableof remote access with the main body 710, and as illustrated in FIG. 12B,a remote device 720 capable of remote access with the main body 710 maybe one or more.

A case in which there are a plurality of remote devices 720 will bedescribed in detail with reference to FIGS. 14 and 16 below.

FIG. 13 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

As illustrated in FIG. 13 , manipulation information by the controlpanel 716 displayed on the second controller 726 may be displayed as aGUI.

The second controller 726 is a virtual control panel corresponding tothe control panel 716 of the main body 710 and may have the same shapeas the actual control panel 716 of the main body 710.

In the present disclosure, as the control panel 716 of the main body 710is manipulated, the manipulation process may be displayed on the secondcontroller 726 in real time so as to match the configuration of thecontrol panel 716 to be manipulated.

Specifically, as illustrated in FIG. 13 , around the configuration ofthe second controller 726 corresponding to the configuration manipulatedon the control panel 716, the movement of the correspondingconfiguration due to the user's manipulation may be displayed in theGUI. As an example, what is displayed in the GUI may be an arrowindicating left and right rotation, vertical movement, a pressed form,and the like.

FIG. 14 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 14 is a diagram illustrating a case where there are a plurality ofremote devices 720 capable of remote access to the main body 710, whichis a diagram illustrating the plurality of second controllers 726 of theplurality of remote devices 720 as second controllers 726 a, 726 b, and726 c, respectively.

An example of manipulation through the second controllers 726 a and 726b and the control panel 716 is illustrated. The second controllers 726 aand 726 b manipulate as indicated in A and C, respectively, and thecontrol panel 716 manipulate as indicated in B, and the abovemanipulation process is displayed as a GUI on the second controller 726c.

From what is illustrated in FIG. 14 , it may be seen that in the secondcontroller 726 a, a manipulation A of rotating one component at theupper side in a counterclockwise direction was performed, the secondcontroller 726 b performed a manipulation C of pressing the SCAN button,and an manipulation B of rotating the ANGLE component clockwise in thecontrol panel 716 was performed.

The manipulation information from the second controllers 726 a and 726 bis transmitted to the control panel 716 of the main body 710, and animage reflecting a plurality of pieces of manipulation information isdisplayed on the main body 710, and a real-time image reflecting themanipulation information is equally displayed on each remote device 720.

The manipulation information displayed on the second controller 726 cmay include not only manipulation information by the control panel 716but also manipulation information via other second controllers 726 a and726 b.

Manipulation information of the plurality of second controllers 726 maybe displayed between the plurality of second controllers 726,respectively, and although only the screen of the second controller 726c is shown enlarged in FIG. 14 , manipulation information of theplurality of second controllers 726 and manipulation information by thecontrol panel 716 may be displayed on the second controller 726 a and726 b as well. In this case, the plurality of pieces of manipulationinformation displayed on the second controller 726 may be displayed inmutually distinguished forms.

For example, it may be displayed in a different display format, such asa color, a shape, a line type, and a line thickness displayed in theGUI.

Due to the display in the mutually distinguished forms, the user usingthe remote device 720 may check whether the current manipulation isperformed on the main body 710 or, if there are a plurality of remotedevices 720, which remote device 720 the manipulation is performed on.

When the manipulation is performed by the plurality of secondcontrollers 726, among the plurality of pieces manipulation information,it may be sequentially displayed starting from the first performedmanipulation, and after all of the previously performed manipulationtasks are finished, manipulation information from the other secondcontroller 726 may be displayed.

Alternatively, the manipulation information of the other secondcontroller 726 may be displayed together even before the previouslyperformed manipulation task is finished. In this case, in order todistinguish the manipulation information performed by each secondcontroller 726 and to distinguish the order in which the manipulation isperformed, it is possible to display a plurality of pieces ofmanipulation information so as to be distinguishable, such as numberingthe display according to a predetermined criterion or making thedisplayed color to be gradually darker.

FIG. 15 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

FIG. 15 is a diagram illustrating that a plurality of pieces ofmanipulation information are displayed on the second controller 726, andas an example of the manipulation information, it may be confirmed thata first manipulation by D1 and D2, a second manipulation by E1 and E2, athird manipulation by F1, and a fourth manipulation by G1 have beenperformed.

Each manipulation information is performed by the second controller 726and the control panel 716, and as each manipulation information isdisplayed on the second controller 726 in a different display format,the user may confirm which manipulation was performed at a remotelocation or control panel.

FIG. 16 is a diagram for explaining a display method of the ultrasoundremote diagnosis system 700 in accordance with an embodiment of thepresent disclosure.

According to an embodiment of the present disclosure, manipulationinformation by the second controller 726 may be displayed on the controlpanel 716 in real time, and FIG. 16 illustrates an example of displayinginformation manipulated by each of the second controllers 726 a and 726b on the control panel 716.

As illustrated in FIG. 16 , manipulation information of the plurality ofsecond controllers 726 may be displayed on the control panel 716,respectively, and manipulation information by the plurality of secondcontrollers 726 displayed on the control panel 716 may be displayed inmutually distinguished forms.

According to an embodiment, the manipulation information displayed onthe control panel 716 may be displayed in a blinking manner of thecontrol panel manipulator 718.

The control panel manipulator 718 refers to configurations manipulatedon the control panel 716, and although configurations manipulated by thesecond controllers 726 a and 726 b are displayed as a control panelmanipulator 718 in FIG. 16 , in addition to the configurations indicatedas the control panel manipulator 718 in FIG. 16 , the manipulationconfiguration on the control panel 716 may be the control panelmanipulator 718.

In the control panel 716, a lightable LED is disposed on the buttonitself on the control panel 716, the switch, or its periphery, sowhether or not it has been manipulated may be displayed by turning onthe corresponding LED.

When the plurality of second controllers 726 are manipulated, therespective LED lighting colors may be different to distinguish them fromeach other. In addition, the manipulation information by the controlpanel 716 and manipulation information by the second controller 726,displayed on the control panel 716, may be displayed in mutuallydistinguished forms.

The ultrasound remote diagnosis method according to an embodiment of thepresent disclosure is an ultrasound remote diagnosis method of theultrasound remote diagnosis system including a main body 710 including amain panel 712, a touch panel 714, and a control panel 716, and a remotedevice in communication with the main body 710.

The method includes independently receiving, by the remote device 720,among display data which is real-time image information of the mainpanel 712, first control data which is real-time image information ofthe touch panel 714, and second control data which is a virtual controlpanel corresponding to the control panel, at least each informationcorresponding to the display data and the first control data, from themain body 710, displaying, by the remote device 720, a display part 722,a first controller 724, and a second controller 726 respectivelycorresponding to the display data, the first control data, and thesecond control data so as not to overlap, and includes, in order formanipulation information by any one of the control panel 716 and thesecond controller 726 to be displayed on the other one, mutuallytransmitting the manipulation information between the main body 710 andthe remote device 720.

According to an embodiment, displaying manipulation information by thecontrol panel 716 on the second controller 726 in real time may beincluded, and displaying manipulation information by the secondcontroller 726 on the control panel 716 in real time may be included.

Since detailed information related to each step has been sufficientlydescribed in relation to the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure, a detaileddescription thereof will be omitted.

Hereinafter, a remote track ball 727 control method of an ultrasoundremote diagnosis system 700 according to an embodiment of the presentdisclosure will be described.

FIG. 17 is a diagram for explaining a remote track ball 727 controlmethod of the ultrasound remote diagnosis system 700 in accordance withan embodiment of the present disclosure.

As illustrated in FIG. 17 , the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure includes a mainbody 710 including a main panel 712, a touch panel 714, and a controlpanel 716, and a remote device 720 in communication with the main body710.

The remote device 720 is configured to independently receive, amongdisplay data which is real-time image information of the main panel 712,first control data which is real-time image information of the touchpanel 714, and second control data which is a virtual control panelcorresponding to the control panel 716, at least each informationcorresponding to the display data and the first control data, from themain body 710, and display a display part 722, a first controller 724,and a second controller 726 respectively corresponding to the displaydata, the first control data, and the second control data so as not tooverlap, and manipulation information of the remote track ball 727 isinput by at least a part of the second controller 726 including theremote track ball 727 image or the periphery of the remote track ball727 image.

According to another embodiment of the present disclosure, an ultrasoundremote diagnosis system 700 includes a remote device 720 incommunication with a main body 710 including a main panel 712, a touchpanel 714, and a control panel 716, wherein the remote device 720 isconfigured to independently receive, among display data which isreal-time image information of the main panel 712, first control datawhich is real-time image information of the touch panel 714, and secondcontrol data which is a virtual control panel corresponding to thecontrol panel 716, at least each information corresponding to thedisplay data and the first control data, from the main body 710, anddisplay a display part 722, a first controller 724, and a secondcontroller 726 respectively corresponding to the display data, the firstcontrol data, and the second control data so as not to overlap, whereinthe second controller 726 includes a remote track ball 727 imagecorresponding to a track ball of the control panel 726, and manipulationinformation of the remote track ball 727 is input by at least a part ofthe second controller 726 including the remote track ball 727 image or aperiphery of the remote track 727 ball image.

According to another embodiment of the present disclosure, an ultrasoundremote diagnosis system 700 includes a main body 710 in communicationwith a remote device 720, wherein the main body 710 includes a mainpanel 712, a touch panel 714, and a control panel 716, and a remotedevice 720, in order for the remote device 720 to display a display part722, a first controller 724, and a second controller 726 respectivelycorresponding to display data which is real-time image information ofthe main panel 712, first control data which is real-time imageinformation of the touch panel 714, and second control data which is avirtual control panel corresponding to the control panel 716, so as notto overlap, and the main body 710 is configured to receive manipulationinformation of a remote track ball 727 input by at least a part of thesecond controller 726 including a remote track ball 727 imagecorresponding to a track ball of the control panel 716 or a remote trackball 727 image of the second controller 726.

A main body 710 in communication with a remote device 720 may beincluded, and the main body 710 may include a main panel 712, a touchpanel 714, and a control panel 716, and a remote mouse 750 configured tocontrol the remote track ball 727 of the second controller 726 may beincluded.

The first controller 724 may be controlled through the remote mouse 750,and the second controller 726 may be controlled through at least one ofthe remote mouse 750 and the remote keyboard 760.

In the ultrasound remote diagnosis system 700 of the present disclosure,the touch panel 714 and the first controller 724, the control panel 716and the second controller 726 may each independently perform two-waytransmission and reception, and at this time, the informationtransmitted from the first controller 724 to the touch panel 714 mayinclude control information by the remote mouse 750 of the firstcontroller 724, and the information transmitted from the secondcontroller 726 to the control panel 716 may include control informationby the remote mouse 750 and the remote keyboard 760 of the secondcontroller 726.

FIG. 18 is a diagram for explaining a method of controlling remote trackball 727, in a remote track ball 727 control method of the ultrasoundremote diagnosis system 700 in accordance with the present disclosure.First, in FIG. 18 , the diagram shown on the left relates to aconventional ultrasound remote device. As a diagram illustrating theconfiguration of a remote location corresponding to a control panel of aconventional main body, as shown, in order to control the trackball onthe control panel, the remote mouse could be moved only within the areaA corresponding to the trackball. In other words, in the prior art, whenthe trackball is operated, the area that may be moved by the mouse at aremote location is narrow, which is inconvenient.

The diagram shown on the right side of FIG. 18 is a diagram illustratingthe second controller 726 of the ultrasound remote diagnosis system 700according to the present disclosure, and as shown, in the presentdisclosure, the remote mouse 750 may be moved within the entire area Bof the second controller 726 to control the remote track ball 727.

In other words, in the present disclosure, as the movement area of theremote mouse 750 on the remote device 720 is within the area of thesecond controller 726, the movable range of the remote mouse 750 iswidened compared to the prior art, so that there is an effect offacilitating the user's control of the remote trackball 727.

In addition, in order for the user to recognize that the remote mouse750 may move to the second controller 726 beyond the remote track ball727 area A, the second controller 726 of the present disclosure mayindicate the movable area range of the remote mouse 750 in the shape ofan arrow as shown in FIG. 18 .

Depending on embodiments, it may be displayed on the main body 710 thatthe remote mouse 750 in a remote location is selected or operated.

FIG. 19 is a diagram for explaining another embodiment, in a remotetrack ball 727 control method of the ultrasound remote diagnosis system700 in accordance with the present disclosure.

As illustrated in FIG. 19 , the second controller 726 in the presentdisclosure may be a movable area of the remote mouse 750 for controllingthe remote track ball 727, and accordingly, FIG. 19 illustrates variousembodiments for indicating that the entire second controller 726 is amovable area.

In the process of controlling the remote track ball 727, other buttonson the second controller 726 may not be used, and in order to notify theuser of this, when the remote track ball 727 operates, the secondcontroller 726 area may be shaded. In order to indicate that it is amovable area of the remote mouse 750 with shading, arrows may bedisplayed all over the second controller 726 up, down, left and right,the size of the arrows may be increased, or the direction of the arrowsmay be changed to point to both ends, and the available area may beindicated using text.

The method of indicating that it is a movable area is not limited to theabove-listed methods or those illustrated in the drawings, and may bedisplayed in various ways by utilizing the color, transparency, textcontent, location, size, color, type of border line, color, etc.,indicated by the second controller 726.

FIG. 20A is a diagram for explaining size control of a second controller726, in a remote track ball 727 control method of the ultrasound remotediagnosis system 700 in accordance with an embodiment of the presentdisclosure, and FIG. 20B is a diagram for explaining size control of asecond controller 726, in the remote track ball 727 control method ofthe ultrasound remote diagnosis system 700 in accordance with anembodiment of the present disclosure.

The ultrasound remote diagnosis system 700 according to the presentdisclosure transmits information corresponding to the main panel 712,the touch panel 714, and the control panel 716 of the main body 710 asseparate signals to the remote device 720, and on the remote device 720,the display part 722, the first controller 724, and the secondcontroller 726 are displayed so as not to overlap each other, and theirsizes may be independently controlled.

FIG. 20A illustrates the display part 722 on the left area of the remotedevice 720, the first controller 724 on the upper side of the rightarea, and the second controller 726 on the lower side, which illustratesa state in which the size ratio of both sides and the size ratio of theupper side and lower side are equally divided.

Contrary to this, FIG. 20B is a diagram illustrating a remote device 720displayed by reducing the first controller 724 area at the upper side inorder to enlarge the right area by reducing the size of the display part722 in the left area, and further enlarge and display the secondcontroller 726 at the lower side.

While in conventional ultrasound remote devices, as the information inthe main body is integrated and transmitted as a single signal,independent control of each at a remote location was not possible, inthe present disclosure, each size may be controlled independently, andonly some windows in the display part 722, the first controller 724, andthe second controller 726 may be closed or the size may be minimized.

FIG. 21A is a diagram for explaining a second controller 726, in aremote track ball 727 control method of the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure,and FIG. 21B is a diagram for explaining a second controller 726, in theremote track ball 727 control method of the ultrasound remote diagnosissystem 700 in accordance with an embodiment of the present disclosure.

The second controller 726 in the present disclosure is a virtual controlpanel corresponding to the control panel 716 of the main body 710 andmay have the same shape as the actual control panel 716 of the main body710.

The second controller 726 illustrated in FIGS. 21A and 21B, illustratedas an example of the second controller 726, has different buttonsprovided on each, different functions by buttons, and slightly differentshapes of buttons around the remote trackball 727.

As such, the second controller 726 displayed on the remote device 720corresponds to the model of the control panel 716 of the main body 710,and model information and second control data of the control panel 716may be previously stored in the ultrasound remote diagnosis system 700.

FIG. 22 is a diagram for explaining a second controller 726, in a remotetrack ball 727 control method of an ultrasound remote diagnosis system700 in accordance with an embodiment of the present disclosure.

In the control method of he second controller 726, the user may set ashortcut key for controlling the second controller 726 on the remotekeyboard 760.

Specifically, manipulation buttons and manipulation contents frequentlyused by the user in the second controller 726 may be designated to aspecific key on the remote keyboard 760 in advance, and may be utilizedas a shortcut key. There is an advantage in that the user's controlbecomes convenient in that it is performed only by pressing the keybutton of the remote keyboard 760 without the need to move the remotemouse 750.

FIG. 22 illustrates an example of a shortcut key, and in the case ofconfiguration (a) of the second controller 726, the number 1 of theremote keyboard 760 is designated, and the − and + buttons aredesignated to F1 and F2 of the remote keyboard 760.

In the case of configuration (b), the number 2 of the remote keyboard760 is designated, and in the configuration (c), the number 3 of theremote keyboard 760 is designated.

In the case of configuration (d), the alphabet R of the remote keyboard760 is designated, in the case of configuration (e), the alphabet T ofthe remote keyboard 760 is designated, and in the configuration (f), thealphabet Y of the remote keyboard 760 is designated.

In addition, in configuration (g), the alphabet I of the remote keyboard760 is designated, in configuration (h), the ‘ENTER’ key of the remotekeyboard 760 is designated, and in the case of configuration (i), the‘DELETE’ key of the remote keyboard 760 is designated.

FIG. 22 illustrates an example of a shortcut key, and in addition to theillustrated things, various shortcut keys corresponding to the remotekeyboard 760 may be set in the configuration of the second controller726 frequently used by the user.

The configuration illustrated in FIG. 22 illustrates an example of ashortcut key, and in addition to the illustrated things, variousshortcut keys corresponding to the remote keyboard 760 may be set in theconfiguration of the second controller 726 frequently used by the user.

The remote keyboard 760 and the main body keyboard of the presentdisclosure may be mapped one-to-one.

However, if a shortcut key is set in the remote keyboard 760 as setabove, the shortcut key set in the remote keyboard 760 may bepreferentially applied in the remote keyboard 760, and in this case, thecorresponding shortcut key may be effective only in a remote location.

The ultrasound remote diagnosis method according to an embodiment of thepresent disclosure is an ultrasound remote diagnosis method of theultrasound remote diagnosis system including a main body 710 including amain panel 712, a touch panel 714, and a control panel 716, and a remotedevice in communication with the main body 710.

The method includes independently receiving, by the remote device 720,among display data which is real-time image information of the mainpanel 712, first control data which is real-time image information ofthe touch panel 714, and second control data which is a virtual controlpanel corresponding to the control panel, at least each informationcorresponding to the display data and the first control data, from themain body 710, displaying, by the remote device 720, a display part 722,a first controller 724, and a second controller 726 respectivelycorresponding to the display data, the first control data, and thesecond control data so as not to overlap, and while the secondcontroller 726 includes a remote track ball 727 image corresponding to atrack ball of the control panel 716, inputting manipulation informationof the remote track ball 727 by at least a part of the second controller726 including the remote track ball 727 image or a periphery of theremote track ball 727 image.

Since detailed information related to each step has been sufficientlydescribed in relation to the ultrasound remote diagnosis system 700according to an embodiment of the present disclosure, a detaileddescription thereof will be omitted.

The disclosed embodiments have been described with reference to theaccompanying drawings as described above. Those skilled in the art towhich the present disclosure pertains will understand that the presentdisclosure may be practiced in forms different from the disclosedembodiments without changing the technical spirit or essential featuresof the present disclosure. The disclosed embodiments are illustrativeand should not be construed as limiting.

What is claimed is:
 1. An ultrasound remote diagnosis system, comprising a main body in communication with a remote device, wherein the main body comprises a main panel, a touch panel, and a control panel, and in order for the remote device to display a display part, a first controller, and a second controller respectively corresponding to display data which is real-time image information of the main panel, first control data which is real-time image information of the touch panel, and second control data which is a virtual control panel corresponding to the control panel, so as not to overlap, the main body is configured to independently transmit, among the display data, the first control data and the second control data, at least each information corresponding to the display data and the first control data, to the remote device, and wherein in a measurement mode for measuring an object based on a marker set in an ultrasound image displayed on the main panel, the marker information for measurement input to at least one of the display part, the first controller, and the second controller is received by the main body to be displayed on the main panel.
 2. An ultrasound remote diagnosis system, comprising: a main body comprising a main panel, a touch panel, and a control panel; and a remote device in communication with the main body, wherein the remote device is configured to: independently receive, among display data which is real-time image information of the main panel, first control data which is real-time image information of the touch panel, and second control data which is a virtual control panel corresponding to the control panel, at least each information corresponding to the display data and the first control data, from the main body; and display a display part, a first controller, and a second controller respectively corresponding to the display data, the first control data, and the second control data so as not to overlap, and the main body is configured to, in a measurement mode for measuring an object based on a marker set in an ultrasound image displayed on the main panel, receive the marker information for measurement input to at least one of the display part, the first controller, and the second controller of the remote device and display on the main panel.
 3. The ultrasound remote diagnosis system of claim 1, wherein in the measurement mode, a measurement process performed by the main body and the remote device is displayed in the same manner on the main panel and the display part.
 4. The ultrasound remote diagnosis system of claim 1, wherein in the measurement mode, at least one of a first pointer corresponding to a mouse cursor of the main body and a second pointer corresponding to a mouse cursor of the remote device are displayed on the display part.
 5. An ultrasound remote diagnosis method of an ultrasound remote diagnosis system comprising a main body comprising a main panel, a touch panel, and a control panel, and a remote device in communication with the main body, the ultrasound remote diagnosis method comprising: independently receiving, by the remote device, among display data which is real-time image information of the main panel, first control data which is real-time image information of the touch panel, and second control data which is a virtual control panel corresponding to the control panel, at least each information corresponding to the display data and the first control data, from the main body; displaying, by the remote device, a display part, a first controller, and a second controller respectively corresponding to the display data, the first control data, and the second control data so as not to overlap; and in a measurement mode for measuring an object based on a marker set in an ultrasound image displayed on the main panel, receiving, by the main body, the marker information for measurement input to at least one of the display part, the first controller, and the second controller to display on the main panel.
 6. The ultrasound remote diagnosis method of claim 5, further comprising: in the measurement mode, displaying a measurement process performed by the main body and the remote device in the same manner on the main panel and the display part.
 7. The ultrasound remote diagnosis method of claim 5, wherein in the measurement mode, at least one of a first pointer corresponding to a mouse cursor of the main body and a second pointer corresponding to a mouse cursor of the remote device is displayed on the display part.
 8. The ultrasound remote diagnosis method of claim 7, further comprising: executing the measurement mode by moving the second pointer inside an area of the display part or through control of the second controller.
 9. The ultrasound remote diagnosis method of claim 5, further comprising: executing the measurement mode through control of the main panel or the touch panel.
 10. The ultrasound remote diagnosis method of claim 7, wherein a measurement in the measurement mode uses at least one of the first pointer and the second pointer.
 11. The ultrasound remote diagnosis method of claim 7, further comprising: when the second pointer is located within an area of the display part, displaying the second pointer in a form of a measurement marker.
 12. The ultrasound remote diagnosis method of claim 11, further comprising: specifying a first point by clicking a first measurement marker displayed at a point where the second pointer is located; and specifying a second point by clicking a second measurement marker displayed at a location where the second pointer moved.
 13. The ultrasound remote diagnosis method of claim 12, further comprising: displaying a connection line connecting the first point and the second point.
 14. The ultrasound remote diagnosis method of claim 5, wherein the touch panel and the first controller, and the control panel and the second controller each independently perform two-way transmission and reception.
 15. The ultrasound remote diagnosis method of claim 5, wherein the remote device capable of remotely accessing the main body is at least one. 